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Abstract 

What is common in a black hole and a bell-shaped curve? The question does not seem to make 
much sense but it is argued that black holes and the limit distributions of probability theory share 
several properties when their entropy and information content are compared. In particular the no- 
hair theorem, the entropy maximization and holographic bound, and the quantization of entropy of 
black holes have their respective analogues for stable limit distributions. This observation suggests 
that the central limit theorem can play a fundamental role in black hole statistical mechanics and 
in a possibly emergent nature of gravity. 
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Ever since the pioneering work of Bekenstein [1] and Hawking [2] black hole (BH) ther- 
modynamics remained one of the most intensively studied subjects in gravity research [3,4] . 
This can be attributed to the fact that the thermal properties of BHs seem to have a funda- 
mentally quantum gravitational origin: quantities such as the temperature and entropy of 
a black hole depend both on Newton's constant G and Planck's constant h. Interestingly, 
the several different approaches to the quantum theory of gravitation exhibit a profound 
universality [4]: at the microscopic level these considerations attribute the BH entropy to 
different microstates, nevertheless all of them correctly reproduce the Bekenstein-Hawking 
formula S'bh — A/A relating the entropy 5'bh of a black hole to the surface area A of its 
event horizon measured in Planck units. 

A possible cause of this surprising and not fully explained success may lie in the central 
limit theorem (CLT) of probability theory. The CLT provides the core of the mathematical 
foundations of statistical mechanics [5] and hence its utility in a deeper understanding of 
BH entropy would not be totally unexpected. 

The essence of CLT is not that foreign to the realm of black holes. BHs are formed 
by the aggregation of masses until the limit of a gravitational collapse is reached. The 
CLT deals with aggregation of independent and identically distributed random variables 
and specifies the probability distribution of the properly normalized aggregate in the limit 
of an infinite number of its individual components [6]. The CLT tells that the common 
distribution of the aggregated degrees of freedom displays an overwhelming simplicity and 
universality. Approaching the limit, the details of the individual components' distribution 
progressively disappear and finally one arrives at a probability law characterized only by a 
few parameters. Moreover, the same limit law will emerge for infinitely many different choices 
of the aggregated components. If the first two moments of the individual distributions exist 
the limit law is the Gaussian specified fully by its mean and variance. 

The fact that the limit laws obey a very simple shape irrespective of how complex is the 
distribution of the individual components is reminiscent of the no-hair theorem: externally 
a black hole is characterized only by its mass, electric charge and angular momentum. 
Any other information about the collapsing matter such as quantum numbers otherwise 
conserved in laboratory circumstances are not preserved by BHs. In case of the CLT the 
higher order fluctuations of the aggregated random variables are not preserved. These 
fluctuations, however large but finite, are progressively smoothed out as the number of 
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individual components increases. As a result, for the emerging Gaussian only the first two 
cumulant moments exist (mean and variance) all the higher order cumulants characterizing 
higher fluctuations vanish. 

The aggregation of random variables means convolution of their distributions. Convolu- 
tion is an information burning operation, the entropy can not decrease under its repeated 
application. Therefore the limit distributions must have larger entropy than the individual 
components being aggregated. Indeed, the Gaussian law has maximum entropy among the 
probability densities of fixed variance. This was shown by Shannon in his classic paper 
setting the foundations of information theory [7] . 

From the no-hair theorem we know that there is an enormous information loss when 
black holes are formed. Accordingly BHs have much larger entropy than any known object 
of same mass. The entropy of black holes scales with the surface area, 5" ~ A, whereas 
non-BH objects satisfy the 't Hooft entropy bound S < [8]. Recently it was pointed 
out that in the classical limit the maximum entropy of a quantized surface is proportional 
to its area for a wide class of surface quantization schemes [9]. Thus the BH horizon has 
maximum entropy among the spherical surfaces of fixed area. The similarity to limit laws is 
obvious with their variance or width playing the role of BH event horizon area. But it is early 
to conclude that the analogy has solid foundations. The possible existence of hyperentropic 
objects and so-called monster configurations having larger entropy than black holes is still 
debated [10]. 

In close correspondence with entropy maximization by black holes various entropy bounds 
were formulated for ordinary physical systems. The most appropriate for our purposes is the 
holographic bound and its derivation via the Susskind process [8,11]. Consider a spherical 
system of entropy S and surface area A that includes gravity. Let us allow the system to 
collapse into a black hole. During the collapse the initial entropy S increases to S'bh because 
of the second law of thermodynamics whereas the confining area A of the system decreases 
to the black hole event horizon area ^bh- That is, 5" < 5'bh = ^bh/4 < A/A and therefore 
the entropy of any ordinary system is ultimately bounded by its surface area, S < A/ 4. 

The logic of the Susskind process can be applied to probability distributions with the 
role of black holes replaced by limit laws. Consider a random variable x with probability 
density f{x) of finite width but the variance should not necessarily exist. We are interested 
in the upper bound on the Shannon entropy S{x) — — J f{x) \nf{x) dx. Making an infinite 
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convolution of f{x) with itself while the width being kept fixed a Gaussian or Levy limit 
law emerges. Its Shannon entropy is certainly larger than that oi f(x) since entropy can not 
decrease under convolution. A unique property of limit laws is stability: up to a location 

and scale change their shape remains unmodified under convolution. Since entropy is shift 
invariant, it is the scale parameter, i.e., the width what represents the Shannon entropy of 
limit distributions. Therefore S{x) of an arbitrarily chosen probability density is bounded 
by its width. 

Due to the property S{Xx) — S{x)+log X of Shannon entropy it is actually the logarithmic 
width what measures the entropy of stable laws. The A'"-fold convolution of a A = 1 stable 
distribution changes its scale parameter to A = N^/" where a is the index of stability, 
< a < 2. The a = 2 case is the Gaussian, otherwise we have a Levy law with inverse 
power law tail x~^~" [6] . While the width of limit distributions measures the number of stable 
degrees of freedom being aggregated, the surface area of black holes counts the number of 
quantum mechanical degrees of freedom on the event horizon [8,11]. 

The idea that the black hole event horizon might be quantized was suggested by Beken- 
stein already in the first years of research of BH thermodynamics [12]. In his intuitive picture 
the horizon surface is tiled with plaquettes of area of the squared Planck length. Although 
the details of the recent approaches to surface quantization are different, each consistently 
specifies a quantum of area on the event horizon and hence a quantum of entropy being 
proportional to it. 

A somewhat analogous property characterizes the discrete limit distributions. Aggregat- 
ing discrete random variables of finite mean the emerging limit law is the Poissonian. The 
iV-fold convolution of a Poisson distribution of unit mean reproduces it with mean N. Thus 
the mean of the Poisson law measures the number of aggregated degrees of freedom. Impor- 
tantly, this holds for non-Poissonian discrete limit laws as well. They can be decomposed 
into a Poisson distribution of identical clusters. Under convolution only the Poissonian 
component gets modified (its mean increases) the probability distribution inside the clusters 
and hence its Shannon entropy remains unchanged. This behavior is the discrete analogue 
of stability [13]. Therefore the entropy of a non-Poissonian limit law can be thought as 
quantized: its increase under convolution is due to an increasing number of independent 
and identical clusters of fixed Shannon entropy. A possible source of discrete stability is the 
contamination of Levy fiuctuations by Poisson noise. 
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The distribution p{k) inside the clusters has a power law tail The index a is now 

restricted to < a < 1 and it yields the probability p{k — 1). In the limit a ^ 1 the pure 
Poissonian is recovered as the limit distribution. The Shannon entropy of p{k) is fixed by 
the index a being inversely proportional to it. The role of a bears some resemblance with 
the Immirzi parameter determining the size of area quanta in the loop quantum gravity 
approach to black hole entropy [14]. 

We have seen that the stability property of limit distributions plays a central role in es- 
tablishing the correspondence with black holes. For continuous limit laws stability expresses 
a scale symmetry of the same kind what is encountered in renormalization group methods 
applied to phase transitions [15]. Aggregating random variables is the equivalent of forming 
block spins whereas scale invariance of the aggregate represents fixed point behavior near 
the critical point. Therefore the stability of limit distributions is intimately related to the 
observed similarities between BHs and phase transitions [16,17]. Note also that the Levy 
limit laws (continuous or discrete) have power law tails, in accordance with self-similar fiuc- 
tuations of the event horizon's shape which can be responsible of BH entropy [18]. It is 
worth considering that two key concepts of the central limit theorem, the N ^ oo limit of 
aggregated random variables and the stability of the aggregate's distribution arc patterns 
parallel to the N ^ oo limit of SU (N) gauge theories and the holographic nature of BH 
entropy. The latter are two fundamental ideas behind the AdS/CFT correspondence. Thus 
one is led to speculate that a probabilistic view of the holographic principle may be also 
formulated on the basis of the CLT. 

Recently it was suggested that a near-horizon conformal symmetry governs black hole 
thermodynamics, independently of the details of quantum gravity [4,19]. This picture reveals 
an emergent character of the thermal properties of BHs. The correspondence between limit 
laws and black holes may ultimately be rooted in an emergent nature of gravity [17,20] with 
the central limit theorem playing a defining role in it. A less ambitious but more definite view 
of our result is that, similarly to Hawking radiation, black hole entropy also has analogues 
in physics outside general relativity, especially in fiuctuation phenomena which give birth 
of stable probability distributions. In any case, it will be nice to see if a new and fruitful 
interaction develops between probability theory and gravity research. 
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